THE SPEAKING BRAIN: A TUTORIAL INTRODUCTION TO fMRI EXPERIMENTS IN THE PRODUCTION OF SPEECH, PROSODY AND SYNTAX
نویسندگان
چکیده
In this study we will give an overview of the experimental work on the neuroanatomical correlates of language and speech production that we have done in recent years. First we will introduce the methodology of event-related functional magnetic neuro-imaging and the experimental paradigm that we employed. Then we will present and discuss the results of our experiments on (1) speech motor control, (2) articulatory complexity, (3) the neuroanatomical correlates of prosody, and (4) the neurocognitive substrates of syntactic processing. Experiments (1) and (2) show that the expected large motor speech network consisting of SMA, motor cortex and cerebellum is only active in planning and execution of simple articulatory movements. Increased articulatory complexity leads to more focused activation. Furthermore, we can show that only the execution of speech movements recruits the left anterior insula, while articulatory planning does not. The results of experiment (3) indicate that it is not the function of prosody (linguistic vs. affective) that controls lateralisation of prosodic processing, but that more general characteristics of the processing units like the size of the prosodic frame are responsible for the activation of different cortical regions. Finally, in experiment (4) we present first results on syntactic processing in speech production. Besides the expected activation of Broca’s area we found activations in Wernicke’s area and in the cerebellum. We have also found evidence for activations in other cortical areas, which are less often implicated in clinical studies on brain language correlations. The cognitive relevance of these areas and networks is still to be elucidated.
منابع مشابه
Goethe for prosody
In this paper, we describe the way in which a recording of Goethe’s “Die Leiden des jungen Werther” published on a multimedia CDROM [7] was made accessible for prosody research. The recording is interesting for prosody research because of its prosodic richness as it displays a large variety of registers and speaking styles. Application areas are: development of prosody models for German TTS, un...
متن کاملImproving the Robustness of Prosody Dependent Language Modeling Based on Prosody Syntax Dependence
This paper presents a novel approach that improves the robustness of prosody dependent language modeling by leveraging the dependence between prosody and syntax. A prosody dependent language model describes the joint probability distribution of concurrent word and prosody sequences and can be used to provide prior language constraints in a prosody dependent speech recognizer. Robust Maximum Lik...
متن کاملFunctional MR imaging exposes differential brain responses to syntax and prosody during auditory sentence comprehension
In two experiments using event-related functional magnetic resonance imaging we studied healthy adults who listened to sentences that either focused on lexical, syntactic, or prosodic information. In the first experiment two sentence conditions were employed: normal speech which contained function and content words, and pseudo speech which contained function and pseudo words. Sentence processin...
متن کاملThe prosody of embedded coordinations in German and Hindi
This paper reports a cross-linguistic investigation into the syntax-prosody mapping in German and Hindi. For both languages, comparable speech production experiments were carried out, using ambiguous coordination structures with four names in different syntactic conditions. Pitch contours and duration values were compared at syntactic boundaries of the different coordination structures within a...
متن کاملLa structuration prosodique et les relations syntaxe/ prosodie dans le discours politique (Prosodic Structuring and the Syntax-Prosody Relationship in Political Speech) [in French]
_________________________________________________________________________________________________________ Prosodic Structuring and the Syntax-Prosody Relationship in Political Speech Studies on the prosodic structure of French recognize the existence of different types of prosodic constituents. These constituents differ from each other in the way in which they are constructed and realized. Gene...
متن کامل